Continuous replica-symmetry breaking in mean-field spin-glass models: Perturbation 

expansion without the replica trick 
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The full mean-field solution of spin glass models with a continuous order-parameter function is 
not directly available and approximate schemes must be used to assess its properties. The averaged 
physical quantities are to be represented via the replica trick and the limit to zero number of replicas 
is to be performed for each of them. To avoid this we introduce a perturbation expansion for a mean- 
field free-energy functional with a continuous order-parameter function without the need to refer 
to the replica trick. The expansion can be used to calculate all physical quantities in all mean- 
field spin-glass models and at all temperatures, including zero temperature. The small expansion 
parameter is a difference between the continuous order-parameter function and the corresponding 
order parameter from the solution with one level of replica-symmetry breaking. The first correction 
beyond the approximation with one level of replica-symmetry breaking is explicitly evaluated in the 
glassy phase of the Sherrington-Kirkpatrick model. 

PACS numbers: 05.50.+q, 64.60.De, 75.10.Nr 



I. INTRODUCTION 

Strongly disordered and frustrated spin systems, the 
prominent examples of which are spin glasses, display 
a complicated low-temperature behavior. Due to frus- 
tration the standard homogeneous long-range orders are 
precluded and replaced by orderings with peculiar prop- 
erties. First of all, the low-temperature phase shows ev- 
erywhere ergodicity breaking that cannot be removed 
or circumvented by the application of external fields 
or measurable sources^ The free energy of such sys- 
tems manifests in low temperatures a complex landscape 
with almost degenerate metastable states the description 
of which demands advanced mathematical tools ^ The 
usual way to handle the low-temperature behavior of spin 
glasses and other frustrated systems is the replica trick 
transforming static, quenched averaging to a dynamical, 
annealed one.— The limit to zero of the replication in- 
dex (number of replicas) in physical quantities does not, 
however, work as a simple perturbation (loop) expansion 
as initially introduced. One has to use non-perturbative 
techniques to reach a thermodynamically consistent solu- 
tion in the limit of zero replicas. Parisi found a way how 
to break the symmetry of the order parameters in the 
replicated space of a mean-field, Sherrington-Kirkpatrick 
modelj* The dependence of the thermodynamic equilib- 
rium state of spin glasses on the replication index and 
the structure of the order parameters in the replicated 
phase space reflects volatility of the thermodynamic limit 
to boundary conditions or the initial state used for the 
equilibration process. This is demonstrated by the con- 
cept of real replicas used to reconstruct homogeneity of 
the free energy in mean-field spin-glass models^ 

A thermodynamically consistent mean-field solution 
of spin glass models with the full, continuous replica- 
symmetry breaking (RSB) cannot be reached directly 
but only via either an iterative scheme or a perturba- 



tion expansion. The most direct way to approach the 
solution with a continuous replica-symmetry breaking is 
to use discrete hierarchies of mathematical replicas. It 
is, however, almost impossible to go quantitatively be- 
yond a two-level (2RSB) solution.— Moreover, approxi- 
mations with finite numbers of replica hierarchies replace 
the continuous order-parameter function by a set of delta 
functions from which one cannot deduce a detailed struc- 
ture of the distribution of the equilibrium order parame- 
ters. Alternatively, one can expand the full solution near 
the critical transition point to the spin-glass phased— 
Presently, the most advanced construction of the solu- 
tion with continuous RSB is a high-order perturbation 
expansion of a solution of the Parisi nonlinear differen- 
tial equation resolved numerically by means of a pseudo- 
spectral code and Pade approximants^ These expansions 
are applicable only to continuous transitions and to tem- 
peratures not too far below the critical point. 

Only a few attempts have been made to determine the 
structure of the solution with full continuous RSB at very 
low temperatures of the Sherrington-Kirkpatrick model. 
Iterative solutions with a high number of replica hier- 
archies were proposed either with the aid of the renor- 
malization group^ or an expansion around the spherical 
modelfii or the replica-symmetric solution^ They all try 
to assess the impact of the continuous order-parameter 
function and make conclusions on low-temperature prop- 
erties of the Sherrington-Kirkpatrick model. These ap- 
proaches rely on the replica trick and a smooth transition 
from the replica-symmetric to the full RSB solution. 

There are generalized spin-glass models with a struc- 
ture of the phase space of the order parameters differing 
from that of the Ising spin glass. The mean-field solutions 
of the Potts glass fi2. p-spin glass or quadrupolar glass 15 
show intervals of temperature where a first step toward 
the Parisi solution in the replica trick, the so-called one- 
level replica symmetry breaking (1RSB), is locally sta- 
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ble and for some parameters the transition to the glassy 
phase is discontinuous. Except for an asymptotic expan- 
sion near the continuous transition to the glassy phase 
of the Potts model^ there are no other approaches that 
could describe the coexistence and transitions between 
the 1RSB and continuous RSB solutions in these mod- 
els, in particular at low temperatures. 

The aim of this paper is to develop an approximate 
scheme that would be able to interpolate between the 
1RSB and the full continuous RSB solutions in general 
mean-field spin-glass models. We construct it so that to 
be applicable in the whole low-temperature glassy phase 
without referring to the replica trick and covering both 
continuous and discontinuous transitions. The starting 
point will be an explicit representation for the free en- 
ergy with a continuous order-parameter function from 
Ref. [13 where we rescale its variables so that the zero- 
temperature limit is easily accessible. To allow for the 
limit to zero temperature we will have to peel off the 
part corresponding to the 1RSB solution from the full 
free energy. We obtain a suitable form of the free energy 
that will allow us to introduce a perturbation expansion 
around the 1RSB solution in powers of the continuous 
order-parameter function, or better of its correction to 
the respective order parameter from the 1RSB solution. 
We evaluate the expansion explicitly in the first order for 
the Ising spin glass without external magnetic field and 
assess its reliability by comparing its results with the 
high-order expansion around the critical temperature to 
the glassy phase of Ref. [H and with Monte-Carlo simu- 
lations. 

We show in Sec. [TT] how a free-energy functional con- 
taining the 1RSB order parameters together with a con- 
tinuous order-parameter function can be derived from 
the limit of free energies with finite-many hierarchies of 



replica generations breaking the replica symmetry. We 
introduce the appropriate scaling so that the limit to 
zero temperature can explicitly be performed. Stationar- 
ity equations for the limiting free energy without replicas 
are derived in Sec. IIIII The idea and relations needed to 
construct a perturbation expansion around the 1RSB so- 
lution in powers of the continuous order-parameter func- 
tion are presented in Sec. IIVI The lowest order approx- 
imation in closed form is derived in Sec. [Vj Numerical 
results from the first-order of the perturbation expan- 
sion are presented and compared with other methods in 
Sec. I VII We summarize the salient properties of the ap- 
proximate construction in the final Section [VIII 

II. GENERATING FREE-ENERGY 
FUNCTIONAL 

We cannot avoid introducing replicas and hierarchies of 
the replicated phase space if we want to describe thermo- 
dynamic equilibrium of glassy systems. Independently 
whether we do it via the replica trick and the replica 
symmetry breaking scheme or via a successive use of real 
replicas of the phase space to enforce thermodynamic ho- 
mogeneity, we end up with the same result when the repli- 
cation index is analytically continued to real numbers. 
The result is a series of free energy densities labelled by 
a number K of replica hierarchies used. Free energy with 
K replica hierarchies uses 2K + 1 order parameters. We 
have Axi,mi with I = l,...,K, where A\i stands for 
the overlap susceptibility between the original spins and 
those from the Zth hierarchical level and mi is a replica- 
tion index connected with the Zth replica hierarchy. The 
remaining parameter q is the averaged square of the local 
magnetization after K replications. This free energy can 
be represented explicitly as£ 




where we used a sequence of partition functions 

- l/mi 

VXi z™\ 



(lb) 



The initial partition sum for the Ising spin glass reads 

It is the par- 



cosh 



/3 (/ 



tition sum of the original spin model affected by the inter- 
action with the replicated spins represented via fluctuat- 
ing Gaussian fields Ai, . . . , Xk- We denoted the Gaussian 



normalized differential T>\ = dA e A / 2 /a/27t. 

The physical interpretation of free energy f K as dis- 
cussed in Ref. is as follows. We take the partition 
sum of the original model Zq, replicate it mi times and 
average over the spins from the first replica hierarchy. 
We downscale the result by a power l/mi to keep the 
correct spin normalization. The new effective partition 
function Z\ is replicated m,2 times and averaged over the 
spins from the second level of the replicated spins. Af- 
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ter downscaling we go on with higher replica levels. If 
a partition sum Z\ is thcrmodynamically homogeneous 
it becomes independent of the scaling parameter mi+i. 
This just happens if Axz+i = 0. When not, we have to 
go to a higher level of replica-symmetry breaking. Sta- 
tionarity conditions then only minimize deviations from 
the global homogeneity and make free energy fx at least 
locally homogenous, that is, with respect to infinitesimal 
variations of the replication indices. The full RSB solu- 
tion with a continuous order-parameter function is then 



obtained in the limit K — > oo with Ax; ~ 1/K. 

Before we proceed to the continuous limit, K — > oo, we 
rescale the order parameters so that to simplify the ex- 
plicit temperature dependence and to allow for a straight- 
forward limit to low and eventually zero temperature. 
The explicit limit to zero temperature can be performed 
if we rescale the replication indices mi — > fit = f3mi and 
set apart the first overlap susceptibility and the repli- 
cation index that we denote xo,AOi respectively. The 
rescaled hierarchical free free energy is 



f K+1 (qo, Xo, Mo; Axi, • ■ • , Axk ; Mi) • • • > m) 



P 4 



1 - Qo - Xo - Ax; J + j 



i=i 



K 



2 go + A X i + Xo 



;=i 



\Y^inA X i 2 (?°+E Ax^+Ax ; -^(^ (...(z Q {h ri + \^+k K y°/f ) ) 



Pi /Mo 



Ck//ik-i 



(2) 



where we denoted h v = h + Ak — J2i=i A;%/Ax;, represented a; 

(X(\i))x, = J^VXiXiXt), and relabeled q q a . 
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The asymptotic expansion near the critical tempera- 
ture in Ref. @ and @ proves that in the continuous limit 
K — » oo we indeed have Ax; = 0(if -1 ) and A/i; = 
W - MJ+i = 0{K- 1 ). We denote X = K~ l A X i 
and x = K~ l Y^=i Ax; for x € [n/if, (n + 1)/Jf]- Then 
the overlap susceptibilities Axz are no longer order pa- 
rameters in the continuous limit. They only form an 
index set for the continuously distributed replication in- 
dices n{x). The generating free-energy functional for the 
solution with continuous RSB can be represented as a 
functional 17 



/(<7o,Xo,Mo;^,mO)) = --^ln2-^(l-g -Xo-^) 2 

1 1 f x 

+ ^oXo [2 (qo + X) + xo] + 2 J dx/j,(x) [q +X- x] 



(g^X,h 71 )) v . (3) 



9n(x, h) = E (h; x, 0) o g^h) 



+ liWg'toh + hfa] }g„(h + h) 



(5) 



h=0 



where we used prime to denote the derivative with re- 
spect to the magnetic field h, g'^(y,h) = d^g^y,!^ and 
introduced a " time-ordering" operator T y ordering prod- 
ucts of y-dependent non-commuting operators from left 
to right in the y-decreasing succession. The time-ordered 
exponential is then defined as a power series of multiple 
integrals 



T y exp 




dy n O{yi) . . . 0(y n ) 



The interacting part of the energy g^ix, h) obeys a Parisi- 
like non-linear differential equation 



dg^(x,h) _ 1 
dx ~ 2 



d 2 g ll {x, h) ^ ( dg^x, h) 



dh 2 



Oh 



(4) 



as can be determined from the limit K —> oo in the same 
manner as in Ref. [H Its solution can conveniently be 



Time-ordering operators are a standard tool in represent- 
ing quantum many-body perturbation expansions. 

The initial interacting free energy being propagated by 
the evolution operator Eo(/i; X, 0) is the interacting part 
of the 1RSB free energy 



1 



9ii{h) = - In 



^ 2 / 2 [cosh (/3(h + <V*H))P // ' . (6) 
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To complete the expression for the free energy with 
continuous RSB we have to add an equation for function 
g' (x,h). From the definition of the evolution operator 
Eq we obtain directly 



dg^{x,h) 



dh 



= E (h;x,0)og' (h) 



dy /i(y)E (/i; x, y) o [g'^y, h)d h g^(y, h)] . (7e 



The solution to this integral equation can be represented 
via the fundamental evolution operator for this theory 
with a shifted T-ordered exponential 



g' fl (x,h)=E(h;x,0)og' IM (h) 
= T y exp I I dy 



2 h 



+fi(y)g' fl (x,h + h)d h \}g'^h + h) 



(7b) 



h=0 



The equilibrium state is a stationary solution of free 
energy f(q ,xo, Ho; X, [i(x)) from Eq. It is invari- 

ant with respect to infinitesimal variations of the scalar 
order parameters go , Xo , A*o > X and the continuous order- 
parameter function fj,(x) for x G [0, X]. We can re- 
late our variables with the standard Parisi representa- 
tion of the continuous order- parameter function qp(xp) 
via a transformation xp — > /3 _1 [/io + n{X — x)] and 
q P {x P ) -> q + xo + x. 



III. STATIONARITY EQUATIONS 

The advantage of the representation of the free en- 
ergy with a continuous RSB from Eqs. dSJ) - (fTJ is that 
we can derive the stationarity equations in the standard 
way used in statistical mechanics. Evaluating first the 
derivatives with respect to qo, Xo and Ho we obtain 



qo = (g^X,h v ) 2 ) v , 
(Mo - P)xo + P = (E(h v ; X, 0) o g''{h v )) 7 



(8a) 



■/3<E(/i„;X,0)o [g'^h,) 2 ]) , (8b) 



^-Xo [2( 9 o + X) + X o] = i (E(h n ; X, 0) 

o (p^hrf, Xy/xo) In cosh [P{h n + A A /Xo)]) A ) J) 

- (E(h n ; X, 0) o In (cosh^^ [/3(h v + \y/xo~)}' 
H \ \ 1 a / n 



where we denoted 



cosh [(3(h + Ay^)] 

W/9 



(9) 



(coah[j9(fe + A^co)]' /x 
We already mentioned that the individual overlap sus- 
ceptibilities Axi are no longer variational parameters in 
the free energy with continuous RSB. But their sum 
X = JW 1 J^i ^xi is. A stationarity equation for this 
parameter reads 

X = (E(h v ;X,0) O [g^h ri ) 2 ]) v ~{g^X,h 11 ) 2 ) v . (10) 

Finally, we have to use the stationarity condition for 
the free energy from Eq. ([3]) with respect to infinitesimal 
variations of the order-parameter function fi(x). It is 
easy to find that it can be expressed as 



x={E{h v ;X,Q)o[g' ll {h v f]) v 

-(E(h r ,;X,x)o[g' fi (x,h v f]) ri 



(11) 



valid for any x G [0,X]. Note that Eq. ([TT]) for x = 
is trivial and for x = X coincides with Eq. (flO| . Hence, 
only equations for < x < X bring new information for 
the determination of /x(x). 

There is no explicit dependence on /j.(x) in Eq. (jlip . 
It is hence difficult to use it for the determination of this 
order-parameter function. Since this equation holds for 
any x, also its derivative with respect to x must equally 
hold. The derivative reads 

l = (E(h v ;X,x)o [g';(x,h v ) 2 ]) ti , (12) 

which is just a condition for marginal stability of the 
solution with continuous RSB, 17 We recall that the prime 
stands for the derivative with respect to the magnetic 
field. 

Neither here we see function /j,(x) explicitly. Yet an- 
other differentiation is needed to obtain an explicit ex- 
pression for the order-parameter function being 



(E(h 71 ;X,x)o[g';(x,h ri ) 2 ]) v 
2(E(h n ;X 1 x)o[g»(x,h v )*\) 7 



(13) 



(8c) 



This equation will prove suitable for approximate evalu- 
ations. It is also possible to use another derivative and 
to obtain an explicit equation for fi(x) = dfi(x)/dx that 
corresponds to —dx p / dqp in the Parisi notation and is in- 
terpreted as the probability distribution of pure states*^ 
We obtain for this derivative 
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2£(x) (E^; X, i) o [g»( x , h r f] ) v = - (E(h n ; X, x) o 

+ 12»(x)(E(hr,;X,x)o [g'^x,h v )g^{x,h v ) 2 ]) -6fx(x) 2 (E(h ri ;X,x)o[g';(x,h ri ) 4 ]) . (14) 




We see that the second term on the right-hand side has 
the opposite sign from the others and we hence cannot 
generally guarantee negativity of fi{x). 

To complete the stationarity equations we add explicit 
expressions for the derivatives of the initial interacting 



free energy g^,{h). With the above introduced notation 
we have 

9' tt (h) = (Pn(h,\^)t(h x )) x , (15a) 



gZ(h) = f3( Ptl (h,\^)(l-t(hx) 2 )) x + fi (p fl (h,X^)t(hxf) x -(p fl (h,X^)t(h x ))l , (15b) 



g™(h) = 2 ( Pfl (h, X^)t(h x )) x [ P 2 ( Pfi (h, \VxE)t(hx))t - P 2 \ + (2/3 2 - 3/3/x Q + /ig) ( Plt (h, X^)t(hx) 3 ) x 

+ 3 M o(/3 - Mo) ( Pt t{h, X^)t(hx)) x ( P »{h,XVxV)t(hx) 2 ) x ■ (15c) 



We denoted t(h x ) = tanh[/3(/i + A^/xo)]. Combining the 
above equations and the definitions for the derivatives 
of free energy g^ we can transform the equation for the 
overlap susceptibility xo to 



Xo = (E(h v -X,0)o[( P ^h ri ,X^)t(hx, v ) 2 ) x ]) j 



(16) 



where we abbreviated h, h x — h + V\/W> + ^\/Xo- 

The stationarity equations fully determine equilibrium 
states of the mean-field free energy with a continuous 
order-parameter function. These equations are not solv- 
able in their full exact form, being a consequence of in- 
ability to solve the Parisi nonlinear partial differential 
equation Q . Before we resort to approximations we can 
use the above representation of the free energy and de- 
rive exact representations for the equilibrium values of 
interesting physical quantities. We can do that in the 
standard way of statistical mechanics without referring 
to replicas and the discrete representations used in the 
derivation of the final form of the free energy with a con- 
tinuous order-parameter function. 

We first evaluate the homogeneous magnetic suscep- 
tibility. If we use the condition for marginal stability, 
Eq. (fT2j), we obtain 



XT = (g"(X,h n )) v 



= /3(1 - Qo - Xo - X) + fioxo + / dxfi(x) . (17) 

Jo 

It was argued that \t = 1 in the glassy phased This 



cannot be deduced from this exact representation with- 
out further reasoning. 

As a next interesting thermodynamic quantity we eval- 
uate entropy. For this purpose we have to calculate the 
temperature derivative of the initial free energy g^. With 
the above notation we easily derive 



(p^(h v ,,XVXo) In cosh [P{h n .x)}) } 



Qrp ' 'V A.U/ — -— IT V-H-^/il X 

- Pxo [P + 0"o - P) { P ^{h ni A n /Xo)*(/i I) ,a) 2 > a ] 

Vx^(N,a)) a • (18) 

Using again the condition for marginal stability and 
the equations for the equilibrium values of the scalar or- 
der parameters we end up with an expression for entropy 

S(h,T) = - 9f f T T) = ln2+p X o(P~^)(X + q +Xo) 
+ (E(^; X, 0) o (p^h v , X^xol In cosh [P{h v ,x)]) x ) n 

- p (E(h v ; X, 0) o [h ( Pli (h v , AVx)*(N,a)) a ] >„ 

B 2 

-l3 2 Xo~PqoXT- ^(1 - qo - xo - X) 2 . (19) 

The last four terms on the right-hand side of Eq. (JTHJ) 
have negative sign and are potentially dangerous for turn- 
ing the entropy negative at low temperatures. 



IV. PERTURBATION EXPANSION 

Since we cannot solve the stationarity equations for 
the order parameters of the free energy with continu- 
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ous RSB, we resort to approximations. We decomposed 
the full free energy into the zeroth order, corresponding 
to the 1RSB state, and a correction depending on the 
continuous order-parameter function /j.(x). It is natural 
to formulate a perturbation expansion around the 1RSB 
solution in powers of function /i(x). We can do it ei- 
ther directly by using functional derivates and function- 
al of fJ,(x) or by introducing an interpolation parameter 
£ € (0, 1) with which we rescale function (a(x) and expand 
all quantities in £. We choose the first way. 

The fundamental quantity to be expanded is the evo- 
lution operator 



E(h v ;X,0)=T x expi^J dx 



-d\ +fi(x)g' ll (x,h v + h)dj l 



(20) 



h=0 



We have an explicit dependence of this operator on func- 
tion n(x) and an indirect one via the scalar order param- 
eters qo,Xo^o, X and function g' (x,h v ). To determine 
the complete dependence of the evolution operator on 
we must first evaluate the derivatives with respect 
to these parameters. 



Dependence on the upper bound X is specific and leads 



to 



dE{h; X, 0) 
dX 



-dl + f i(X)g'(X,h)d- h 



E(h;X,0) 



(21) 

Partial derivatives with respect to all other scalar param- 



J 



eters have the same generic representation 
8E(h;a,b) 



dp 



dxfi(x) 



E(h; a, x) 



dg' ll (x,h + h) 
dp 



d- h E(h; x, b) . (22a) 



From the defining equation for function g'^, Eq. (|7b[) . we 

dg'M 



obtain 

dg'Jx,h) 



dp 



= E(h;x,0) o 



dyv(y)E(h;x,y) o 



dp 



dg'f,(y,h) 



dp 



. (22b) 



We do the same with the functional derivative with 
respect to fJ,(x), 



SE(h;a,b) 



5fx(x 

+ / dy^(y)E(h;a,y) o 

J X 

and 



= E(h; a, x) o \_g'Ax, h)dhE(h; x, &)] 

Sg'f,{y,h) 



d h E(h;y,b) 



5fi(x) 

= E(h;x,y)o [g'(y,h)g'^y,h)] 



(23a) 



duu(u)E(h; x, u) o 



5q',,(u,h) ,, 



(23b) 



Putting all the derivatives together we can set a basic 
equation for an iterative determination of the next ap- 
proximation to the full evolution operator. Knowing the 
nth and (n— l)th orders of this operator E^ n ) (h; a, b) and 
E^ n ~ 1 \h; a, b) the next approximation then is 



l {n+1 \h;a,b) =E {n) {h-a,b) 
+ / dxfi(x) 



""(/':«...>./;,(•'■/' - h)i) h V"[lr..r.b) - ,\, ( \ d l + K^g'^X, h)d~ h ) E™(h; X, b) 

(») 



5fi(x) \2 



f X , « fx-^ 8vi dq'(x,h + h) Sq'(x,h + h)\ , 

+ J o dyn{y)E^(h;a,x) ( g g ^ y) * g p . -+0{x-y) M d- h E^(h;x,b) 



(24) 



where pi € {<ZOjXo >/•*()} an d [-FIM^)]]^ means that only the nth power of function a{x) from functional F[a{x)\ 

is taken into account. That is 



[F[n(x)]] (n) 



dx-\ 



. dx n (j,(xi) . . . fi(x n ) 



6 n F[n(x)] 



Sfj,(xi) . ..5u(x n ) 
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The initial evolution operator is 

E^(h;a,b)=0xp(^(a-b)8^ 



(25) 



and we set E^ -1 ) = to comply with Eq. for n = 0. 

In this way a formal power expansion in the continuous 
order-parameter function is exhaustively defined. 



V. LOWEST-ORDER APPROXIMATION 

The zeroth-order approximation is the 1RSB free en- 
ergy with the evolution operator approximated by for- 
mula (|2"5j) . This evolution operator can be transformed 
to a Gaussian integral. To make the expressions for the 
equations within this approximation as compact as pos- 
sible we introduce the following generic notation 



E x [f(h)\ 



e-<» 2 / 2 f(f3(h + ^)) , 

(26a) 

(26b) 



oo v27T 

E xo [coshihyo/Pfih)] 



E X0 cosh(/i)^//3 



The zeroth-order approximation leads to equations where 
it is convenient to replace the parameter q with a new 
variable Y = X + qo . Replacing the exact evolution oper- 
ator E by the approximate one from Eq. (|2"5|) in Eqs. © 
we obtain 



Y = Ey 

Xo = E Y 



( Pfl (h)t(h)f xo 
{p,(h)t(h) 2 ). 



Mh)t(h)Y 



(27a) 



(27b) 



Replication index /ip is determined from 



— Ey 
Mo 



E Y 
InE- 



(p^(/i)lncosh(/i)) xo 



Xn 



cosh(/if°/' 3 



(27c) 



The equation for parameter X follows from Eqs. ([8a] 
and (g7) 



X = Ey 



E, 



(Y-X) 



E x 



Mh)t(h)) Xo 



(28) 



Finally, the continuous order-parameter function from 
Eq. (|13[) in the lowest-order approximation is 



H(x) 



E(Y-x) 




2E(y- x ) 


~E x [g>'{h)f 



(29) 



Defining equations (|27l) determine order parameters 
XojMo,^ of a 1RSB state. It can be seen from a gen- 
erating free energy 

/o(xo,Mo,n = -|(1 - Xo ~ Yf + -^oxo (2Y + X o) 



- iln2- — E Y 

P Mo 



InE- 



cosh(ft)^/ /3 ll (30) 



to which these equations define stationarity points. Free 
energy /o is just the free energy from Eq. ([3]) with the 
evolution operator from Eq. (|2"5j) . 

Parameter X that does not appear in the free energy, 
Eq. (f3"U|). is the first iteration for the length of the in- 
terval on which the continuous order-parameter function 
lives. If X > 0, then a solution with continuous RSB 
exists. Note that Eq. (|28|) has two solutions X = and 
X = Y for h = 0. We can always take the latter one 
as the starting point for the perturbation expansion in 
which the Sherrington-Kirkpatrick (SK) solution is then 
completely circumvented (qsK = 0). It means that we 
always can construct a solution with continuous replica- 
symmetry breaking for h = independently of whether 
an equilibrium state with finite-many replica hierarchies 
is locally stable or not. In an applied magnetic field, a 
non-zero parameter X generally exists if an instability 
condition is satisfied 



Ey \g''{h) 2 ] > 1 



(31) 



with g" (h) from Eq. (| 15b|) and parameters Y, xo and 
Ho being solutions of Eqs. (|2"T|) . It is sufficient if condi- 
tion (f3"Tj) is satisfied for any of the solutions of Eqs. ([2T]) . 
that is, either the paramagnetic, replica-symmetric or 
one-level replica-symmetry-breaking solution. 

Parameters Y,xo,Po determined from Eqs. (|2"T|) define 
a stationarity point of the free energy from Eq. (|30p with 
one level of replica symmetry breaking. Parameter X 
from Eq. (|2"5)l and function p{x) from Eq. (f2T)]) go be- 
yond the 1RSB solution and represent the leading-order 
correction to the 1RSB approximation towards a solu- 
tion with continuous RSB. Parameter X determines an 
interval [0, X] on which the continuous order-parameter 
function fi(x) is defined. Both quantities are determined 
within the 1RSB approximation. 

We must go to the next iteration E*- 1 ) of the evolution 
operator to obtain corrections to the 1RSB results. We 
find from Eq. (JUJ) 



?S 1 \h v ;X,0)of(h v )) =E Y [f(h)} 

+ J* dx»(x){±-J^Eylf»(h)] 



2 5fi(x 

E(Y- X ) [E x [g'^h)} [E x [f[h)\] 



(32) 



To make the representation in Eq. (|32|) explicit we need 
to determine the functional derivative 8X/5^l(x). We add 
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a first-order correction to the 1RSB free energy, which is 



x 



A/i = 2 y o dxn{x)\Y-x 



E. 



(Y-x) 



E x [g'»{h)Y 



(33) 



If we now use free energy /i = /o + A/i as a generat- 
ing functional for parameters xoi fJ>0)Y, X with fj,(x) as 
an external source, the stationarity equations of this free 
energy define the scalar order parameters with their first 
correction due to the continuous order-parameter func- 
tion n(x) obtained from Eq. (|2"5)) evaluated within the 



1RSB approximation. 

If we want to evaluate the first correction to function 
fj,(x) from Eq. (|2l?l) we have to go further and to calculate 
the free energy to the second order in fi(x). The second 
correction to the 1RSB free energy reads 

nX px 

A/ 2 = dx dyn(x)ii(y)E iY -x) [E x [g'^hj] 

Jo Jo 

E {x - y) [E y [g'^h)] E y [<?»]]] • (34) 

If we now add both corrections to the 1RSB free energy 
we obtain a new free energy, exact to second order in 
fJ,(x), that has the following representation 



f 2 ( X o, Mo, X, Y; n(x)) =fo + A/i + A/ 2 

= -7(1 - Xo ~ Y) 2 + i/ioXo (2Y + xo) - —E Y 
4 4 fi 



ln£ v 



(2cosh(/i)) Alo/,3 JJ + - / dx^{x){ Y-x 



x 



E, 



(Y-x) 



Ex[g'^h)} 2 }- dxfi(x) K(ft)] ^x-,) ^ K^)]]] • (35) 



To derive the correction to fi(x) from Eq. (f2T)l) we proceed in the same way as in the exact case. Setting zero the first 
variation of free energy / 2 with respect to fJ,(x) leads to 



Y-x-E, 



(Y-x) 



E x 



WM 2 }}= [dyKy)E( Y -x) [Ex [g'^h)} E [x _ y) [E y E y [<%(hj\]] 

i 

dy^y)E { Y-y)[E y [g^h)]E (y ^ x) [E x [g^h)]E x [ 9 ;(h)]Y . (36) 

E x [g'>{h)] E {x _ y) [E v [g'^h)} 2 + E y [g'^h)) E y [gfHh)]] 
dyfi(y)E {Y _ y) [E y [g'^h)] E (y _ x) [E x [g»(h)] E x [<»]]] (37) 

and the second derivative leads to an equation from which we obtain the desired correction to the order-parameter 
function 



Its derivative with respect to x results in 
1 = E, 



J (Y-x) 



Ex K{h)} 2 ] +2 f d m (y)E {Y _ x) 
J Jo 



2^{x)E {Y -x) E x [g';(h)]' 



E, 



(Y-x) 



Ex[g'^{h)\ 



+ 2 / dy^y)E {Y - x) \e x [g^{h)\ E (x _ y) \zE y [g'^h)] E y [g'^h)} + E y [g'^h)] E y \gW(hj 



x 



+ 2 / dyn(y)E (Y _ y) E y [g'^h)] E (y _ x) E x [g'^{h)] E x g^\h) 



(38) 



I 

Knowing the corrections to all the order parameters, free entropy S(T) by applying our approximation to the exact 
energy of the 1RSB solution and to the evolution oper- formulas, Eq. (|17l) and Eq. p^|) . 
ator we can evaluate corrections also to other physical 

quantities, in particular magnetic susceptibility xt and Approximating all physical quantities by expanding 

the evolution operator in the power series from Eq. (|24[) 
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in the exact equations for their equilibrium values makes 
the approximate theory only approximately thermody- 
namically consistent. That is, entropy calculated from 
Eq. (|19[) with an approximate evolution operator E^ 
does not coincide with the entropy calculated from the 
temperature derivative of free energy fi = /o + A/i, since 
function /j.(x) is treated in the latter as an external source 
that depends via Eq. (|2"9")l on temperature and, conse- 
quently, the two definitions do not coincide. It means 
that thermodynamic consistency is obeyed by approxi- 
mate quantities only to one order lower than that chosen 
in the evolution operator. This deficiency can be removed 
if we had a free energy being stationary also with re- 
spect to infinitesimal fluctuations of function fj,(x). Such 
a free energy is /2 from Eq. (|35|) . It can be treated as a 
generating functional for all its variables, including /i(x). 
The continuous order-parameter function can no longer 
be treated as a perturbation but is rather determined 
sclf-consistently with other scalar order parameters from 
Eq. (|36p . Such an approximation would be fully thermo- 
dynamically consistent and exact up to the second order 
in /z(x) for all physical quantities. 




T x/X 



FIG. 1. (Color online) Edwards- Anderson order parameter 
qEA (left panel) and the continuous order-parameter function 
/i(x) (right panel) calculated using perturbation expansions 
(PE) around the 1RSB and replica-symmetric (SK) solutions. 
Parameter [io of 1RSB is plotted for reference. 



VI. RESULTS 

The starting point of the presented perturbation ex- 
pansion, the zeroth order approximation, is a solution 
with one level of replica-symmetry breaking (1RSB), the 
free energy of which with its order parameters is given 
in Eq. Q30p. The replica symmetric solution is part of 
this approximation if we put xo = and neglect the sta- 
tionarity equation for this parameter. Alternatively, due 
to degeneracy of the solution^ we can choose /xo = /3. 
Then, free energy /o from Eq. (|30p becomes indepen- 
dent of susceptibility xo, which also leads to the replica- 
symmetric solution. The two ways to reproduce the 
replica-symmetric solution correspond to different iden- 
tifications of the Sherrington-Kirkpatrick parameter qsK 
with either xo or Y in our notation. In the former case 
we have Xo — and Y = q$K > 0, while in the latter 
Y = 0,/io = 0, and X o = Qsk > for T < T c = 1. 
The full 1RSB solution is obtained so that parameters 
Xo and Y are calculated self-consistently for each value 
of ^0- The latter parameter is then determined from the 
local maximum of free energy f$ . Without magnetic field 
we have another degeneracy in the 1RSB equation (|2"51) . 
allowing us to choose X = Y. We use the values of pa- 
rameters Y, xo and /io from Eqs. (|27p to determine the 
continuous order-parameter function /j,(x) from Eq. (|2"9"|) . 
In this way we completed the starting approximation to 
which we can evaluate corrections in powers of /i(x). 

We calculated explicitly only linear corrections in func- 
tion n(x) to the 1RSB results. In the perturbation ex- 
pansion around the 1RSB solution for h = we obtain 
X = Y in all orders. Corrections to the parameters from 
the 1RSB solution are calculated from stationarity equa- 
tions for free energy A = /o + A/i from Eq. ([55)1 with re- 



spect to infinitesimal variations of Y, xo and fj,o and with 
an external source fi(x) determined from Eq. (|29p with its 
parameters fixed at the 1RSB values. Or, equivalently, 
one can use the evolution operator E^ from Eq. ((32)) in 
the exact equations for the order parameters from the 
exact free energy. 

For comparison we also applied the expansion in the 
continuous order-parameter to the replica-symmetric so- 
lution. Due to the degeneracy in the identification of the 
SK solution, we must choose the one that is more unsta- 
ble. It appears that the SK solution with xo = QSK leads 
to Y = X = in all orders and we generate no corrections 
to the replica-symmetric solution. The other limit to the 
SK solution with xo = leads to X = Y > 0, qo = in 
all orders of the perturbation expansion. It means that 
an expansion around the SK solution coincides with an 
expansion around the paramagnetic solution with no SK 
order parameter. 

Simultaneously with the perturbation expansion we 
used Monte Carlo simulations on fully connected graphs 
with up to N — 512 spins with different number of 
Monte-Carlo sweeps. Usually we used 4096x256 equili- 
brating steps followed by around one million Monte-Carlo 
steps from which we registered the data for averaging af- 
ter each 16-256 steps for each configuration of the ex- 
change couplings out of 6x1024 random selections^ 

We plotted in Fig. [T] the Edwards- Anderson (EA) or- 
der parameter, being in our notation qEA = Xo + Y, cal- 
culated in the replica-symmetric approximation, 1RSB 
solution and from the first-order of the perturbation ex- 
pansion (PE) around either of these solutions. We can see 
that the perturbation expansion in the first order gives 
almost no correction to the 1RSB approximation, while 
there are tangible changes due to the perturbation ex- 
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FIG. 2. (Color online) Temperature dependence of the 
Edwards- Anderson order parameter resulting from different 
approximations. Left panel: Edwards- Anderson parame- 
ter from the 1RSB solution with first order correction (PE 
(1RSB)), compared with the solution of Ref. [3] (HPE) and 
Monte Carlo simulations. Right panel: Monte Carlo re- 
sult compared with extrapolations of asymptotic expansions 
around the transition temperature T c = 1 (solid line) and zero 
temperature (dashed line). 



pansion when applied to the SK solution. Even more, at 
lower temperatures (T 0.4) the first-order correction 
to parameter X, that equals qsK in the lowest order, 
starts to decrease and wrongly downturns the slope of 
the EA parameter. The reason for this unreliable be- 
havior of the first correction to the SK solution is the 
value of the "small parameter" /z(x) used. The right 
panel of Fig. Q] displays at T = 0.3 calculated in the 
1RSB and SK solutions. The function from the SK solu- 
tion is significantly higher, making thus the perturbation 
expansion around the SK (paramagnetic) solution much 
less reliable than the one around the 1RSB solution. It 
is understandable, since the role of the continuous order- 
parameter function fi(x) is partly overtaken by the scalar 
value fj,o in the 1RSB approximation. Unlike function 
fj,(x), parameter /io is treated non-perturbatively. 

To check reliability of the perturbation expansion we 
compared the Edwards- Anderson order parameter in 
Fig. [5J left panel, with the one obtained from Monte- 
Carlo simulations and the high-order perturbation ex- 
pansion (HPE) of Crisanti and Rizzo, Ref. 0. We 
can see that there is not a big difference between the 
perturbation expansion around the 1RSB solution and 
Monte-Carlo simulations and the expansion of Crisanti 
and Rizzo for temperatures T > 0.3. As one expects, 
a better precision in lower temperatures demands inclu- 
sion of higher orders of the expansion. As a curiosity 
we compared (right panel) the Edwards-Anderson pa- 
rameter from Monte-Carlo simulations with low-orders 
of two asymptotic expansions, one, high-temperature, 
around the transition temperature and the other, low- 




0.4 0.6 

x/X 



0.4 0.6 
x/X 



FIG. 3. (Color online) Stability condition, right-hand side of 
Eq. (H2J, denoted Gi, for the expansion around 1RSB (left 
panel) and around SK (right panel). The curves from top 
to bottom at x — correspond to temperatures T — 0.2, 
T = 0.4, T = 0.6, respectively. 



temperature, around zero temperature. The former ex- 
= 1 - 2T 2 + T 3 while the latter to 



pansion is£iaa 



Qea 



the same order isa q E A = 1 — 1.6T 2 + 0.6T d . We see 
that the Monte-Carlo data are surprisingly well repro- 
duced by the expansions in the respective regions and do 
not differ much from them in the whole glassy phase. It 
is worth noting that the expansions are only asymptotic 
and higher terms destroy this surprising reconstruction 
of the Monte-Carlo Edwards- Anderson parameter. 

An important property of the full Parisi solution is the 
condition of (marginal) stability, Eq. (|12|). that may be 
used as one of criteria of reliability and consistency of 
approximations. We plotted in Fig.[3]the right-hand side 
of Eq. (|12p. denoted by Gi 1 for the first-order expan- 
sion around the 1RSB solution (left panel) and the SK 
solution (right panel) and different temperatures. Both 
approximate solutions worsen their reliability with low- 
ering the temperature but the one around the SK so- 
lution shows much larger deviations from the stability 
value G-2 = 1. The expansion around the 1RSB solution, 
on the other hand, does not violate the marginal stabil- 
ity significantly for all temperatures T > 0.2 and gives 
a good estimate of the behavior of the full solution with 
continuous replica-symmetry breaking. 

Failure of the SK solution to produce physical results 
at low temperatures can be demonstrated on entropy. 
In Fig. [4] we plotted entropy (left panel) and free en- 
ergy (right panel) calculated in the SK, 1RSB, and the 
first-order expansion around 1RSB. We can see that even 
though there is not a big difference in free energy between 
the 1RSB and the expansion around it, an improvement 
in the entropy at low temperatures is tangible and goes 
beyond the high-order expansion of Ref. [9]. Improve- 
ment of the perturbation expansion upon the 1RSB solu- 
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FIG. 4. (Color online) Temperature dependence of entropy 
(left panel) calculated in 1RSB, with first correction to it, 
and the replica-symmetric solution. We also used the data 
for entropy from Ref. [jj. The right panel shows free energy 
of the SK solution (/sk), 1RSB (/o) and the first correction 
to 1RSB (/i). 
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FIG. 5. (Color online) Temperature dependence of magnetic 
susceptibility \t (left panel) and internal energy u (right 
panel) calculated in 1RSB scheme, with first correction to 
it and the replica symmetric solution. Monte Carlo result for 
the internal energy is shown for comparison. 



tion at low temperatures can be demonstrated on mag- 
netic susceptibility xt from Eq. (fTT)) plotted in Fig.[5j left 
panel. It is expected to stay fixed at the value xt = 1 m 
the whole low-temperature phase. 2 — We also plotted tem- 
perature dependence of the internal energy u = / — TS 
and compared the result with Monte-Carlo simulations 
(right panel). 

The continuous order-parameter function is not mea- 
surable and one cannot assess quality of approximations 
on this function. But according to the interpretation of 
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FIG. 6. (Color online) Derivative of the Parisi order pa- 
rameter dxp/dqp — P(qp) corresponding in our scheme to 
—/3~ 1 fi(x) is plotted as a function of qp in the Parisi notation 
for T = 0.4. We also added curves from the Monte Carlo 
calculation and from Ref [s|. 
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FIG. 7. (Color online) Parisi order parameters: qp(xp) as 
obtained in Ref. [9| at two different temperatures, T — 0.4 
(upper curves) and T = 0.6 (lower curves), compared with the 
first order correction to 1RSB of the presented perturbation 
expansion. Parameters xo, /? _1 Mo, an d qsA are marked by 
dotted lines. 



the derivative dxp/dqp in the Parisi notation^ being in 
our approach —/3~ 1 d[j,(x)/dx, we can compare this func- 
tion with the probability distribution of overlap magneti- 
zations P(q) = N~ l J2 s .s> P(s)P(s')5(q ss ' - q) accessible 
via Monte-Carlo simulations.— We plotted this function 
at T = 0.4 in Fig. [51 We added also the result from 
Ref. @ and the perturbation expansion around the SK 
solution. 

Each of the approximations shows a maximum at 
qp = qEA- Except for the perturbation expansion around 
the SK solution, all approximations show the maximum 
for almost the same Edwards- Anderson parameter. The 
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function calculated from the expansion around 1RSB dif- 
fers from the others in two aspects. First, it leads to 
a continuous function only between xo > and qEA- 
Second, the slope of P{qp) with which its maximum is 
reached at the upper end, qEA, is more shallow. Func- 
tion P{qp) in the expansion around 1RSB is not well 
defined at the end points, it has different limiting val- 
ues from left and right. The lower end of the defining 
interval for P{qp) is at qp — xo ~ 0.47. There are in- 
dications that higher orders of the expansion around the 
1RSB solution push this initial value xo — ► at all tem- 
peratures. Parameter xo in the 1RSB solution decreases 
also with increasing temperature and tends to zero when 
T — » T c = 1 with a constant function P(qp) — > 2, the ex- 
act result of the asymptotic expansion around the critical 
temperature^ A nonzero value of xo is, however, indis- 
pensable in approximate treatments if we want to reach 
the limit to zero temperature. 

A more important feature, rather than the position 
of the lower bound of the definition domain of P(qp), 
is the height of its step there. The expansion around 
1RSB leads to P(xo) ~ 0.502 and this result is not 
much affected by higher orders of the expansion. It re- 
produces well the value of Monte-Carlo simulations with 
P(0) « 0.50. The results from the expansions around SK 
and from Ref. Q, being P(0) ~ 0.38 and 0.54, respec- 
tively, do not do that well. The expansion from Ref. [9j 
overshoots the Monte-Carlo initial value and P(qp) then 
decreases for low values of of qp, displays a shallow min- 
imum at q m w 0.28 with P(q m ) ~ 0.49 before it starts to 
steeply grow up to reach the end point. Such a behavior 
is observed neither in the Monte- Carlo data and nor in 
the present perturbation expansion. 

The differences in the behavior of distribution function 
P(qp) between the perturbation expansions from Ref. Q 
and around 1RSB are more transparent in Fig. [7] where 
we plotted function qp(xp) for two different tempera- 
tures, T = 0.6 and 0.4. Function qp(xp) in the latter 
expansion remains zero up to /3 _1 /io at which it jumps to 
qp = Xo- It means that the expansion around 1RSB does 
not allow for metastable states with averaged squared 
magnetization smaller than xo- Both functions almost 
linearly increase up to saturation, where qp — qEA- We 
can see that although there is not a remarkable difference 
in the estimate of the Edwards- Anderson parameter, the 
difference between the two approaches in the value of xp 
at which qp — qEA increases with lowering the tempera- 
ture. Since the high-order perturbation expansion from 
Ref. Q is an asymptotic series around the critical transi- 
tion temperature, the expansion around the 1RSB state 
contains more low-temperature data and can be consid- 
ered as more reliable. 



VII. CONCLUSIONS 

Complexity and low accessibility of reliable mean-field 
approximations in spin-glass models lies in the contin- 



uous order-parameter function one has to introduce to 
reach a thermodynamically consistent solution for all 
temperatures. This function enters the Parisi non-linear 
differential equation (f?]) determining the equilibrium in- 
teracting free energy. This equation is unsolvable and 
one must resort to approximations. There is, however, 
no apparent way how to systematically iterate the full 
solution. The usual way is to use the replica trick and 
approximations with finite numbers of replica hierarchies. 
Although one improves in this way upon thermodynamic 
consistency, one does not learn about the actual ordering 
in the equilibrium state and the phase space of the order 
parameters. It is hence important to have an approx- 
imate scheme addressing directly the continuous order- 
parameter function in the whole glassy phase, includ- 
ing zero temperature, where the thermodynamic incon- 
sistency of discrete approaches is most pronounced. 

Here we proposed a construction of a free energy con- 
taining the order parameters of a solution with one hier- 
archy of replica-symmetry breaking together with a con- 
tinuous order-parameter function. The continuous func- 
tion enters the Parisi non-linear differential equation de- 
termining the interacting part of the free energy func- 
tional. We showed that to reach explicit formulas in the 
limit to zero temperature (/3 — ¥ oo) it is necessary to 
use the 1RSB free energy as the starting point for a per- 
turbation expansion in powers of the continuous order- 
parameter function. The 1RSB solution not only allows 
for the explicit limit to zero temperature but also justi- 
fies reliability of low-order approximations to rather low 
temperatures, which is not the case if we apply the same 
expansion to the replica-symmetric solution, being equiv- 
alent to an expansion around the paramagnetic state. 

We derived explicit equations for all the variational 
parameters including the continuous variational function 
of the generating free-energy functional. We also repre- 
sented relevant physical quantities without the necessity 
to refer to replicas and the replica trick. We showed 
how to construct iteratively systematic approximations 
to all quantities by expanding them in powers of the 
continuous-order parameter function beyond the 1RSB 
representations. We presented a closed form of an ap- 
proximation containing first corrections in the expan- 
sion parameter to all quantities of interest. Comparison 
with Monte-Carlo simulations and the high-order asymp- 
totic expansion of Ref. Q for the Sherrington-Kirkpatrick 
model at zero magnetic field proves that even the lowest 
approximation produces reliable results and offers a qual- 
itative picture of the behavior of the continuous order- 
parameter function in the whole glassy phase. 

There are two promising directions of the application 
of the construction developed here. First, one can investi- 
gate the zero-temperature properties and the behavior of 
physical quantities in the asymptotic limit T — > such as 
entropy and magnetic susceptibility. Second, one can use 
this approximate scheme in generalized spin-glass mod- 
els where one expects first-order phase transitions with 
regions where a 1RSB solution is locally stable and coex- 
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ists with another one with continuous replica-symmetry 
breaking. There are presently no approaches allowing to 
study quantitatively such situations. 

Last but not least, we found an explicit free energy 
with a continuous order-parameter function that is fully 
thermodynamically consistent and exact to first two or- 
ders of this function. It may replace the Parisi solution 
for which there is no explicit or closed-form representa- 
tion. Free energy (|35|) is stationary in the equilibrium 
state with respect to all its variational parameters, in- 



cluding the order-parameter function (x(x). Unlike rep- 
resentation (j3|) generating the Parisi solution, free energy 
/2 from Eq. (|35|) determines /i(x) from a solvable linear 
integral equation (|36[) . Such a free energy can be under- 
stood as a solvable Landau functional for the continuous 
order-parameter function and may shed more light on the 
behavior of solutions with continuous replica-symmetry 
breaking. It can serve as a viable improvement upon 
the 1RSB approximation interpolating between the states 
with discrete and continuous replica-symmetry breaking 
in mean-field spin-glass models. 
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